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"Social indicators" and allied terms such as "social 


” 


OQ 


~ ¥ ee . d 
accounting," "quality of life,” and "mortitoring social change" 


came into use in the mid-1960's. TKese phrases and the ideas ee 


they represented were taken up by social scientists, commenta- | ese 


tors, and*policy makers who sensed that rapid social :changes 
. Pa ent, 


— 
-were taking place, but that these were not known either because 
s ¢ : ; . 
they were not being measured or because they were measured but 
ignored. The administration at that time encouraged the idea 


Ahat social change could and shoulA be measured. It held, more- 


over, that the benefits and costs of domestic social programs . . 


; : / 
are also subject to measurement and that the efficacy of federal Ke 
‘ ‘ : ~~ ig, : 
programs would be increased by improved social measurement and 

‘2 


planning, and by new management analytical techniques. > 
Further support for the development of social indicators 

was provided by a handful of social scientists and public admini- _ 

strators. Their enthusiasm brought forth responses from many ae bd 

disciplines: economists saw a role for their skills as theorists 

and measurers of welfare; sociologists saw sha calavanse ct cs 

their own research tradition in the measurement of social beatae; 

' political scientists sought ways to rationalize government ‘pro- ° ? 
grams; and social workers, public administrators, and a broad 
a 


array of social researchers and practitioners also respohded 


‘to the possibilities in social indicators. 
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Out of this emerged what came tobe known as the “social Se 


indicators movement." "Movement" was an apt. Gesignation in that, 


as in all movements in their initial stages, the participants. 
? 4 F 


Pa 
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= _ were ill-defined as to meabership, had little egantsstion aa 


“ . shared few specific objectives. At “the same: ‘time, ‘those who. 


BS; .Y 18 


were part of the movement sensed great needs and opportunttten 


; | for change, celebrated shared but neceseeetty ansiguous sumbols, ae | 4 
and were led by able and articulate idealists. : ty 
Origins. Many of the an ees of the social indicators 
_ movement can be found in the ork of the sociologist William F. ; ” 
Ogburn, who was research director for President Hoover's Research 
Committee on Social Trends. In 1933, this essecine published 
the monumental Recent Social Trends, a report on social trends 
in the United States. Ogburn was committed to the application 
of social science research to the measurement and elucidation 
‘ . of changes in society. This knowledge, he believed, could be 
used in social planning. In 1929, he set forth his views on the 
significance of such research: ‘ 
..¢there is a continuity in cultural change; one event 
‘ ; grows out of-another...the knowledge of what has occurred 
and of what is happening is the safest guide we have: 
With more complete statistics and with better measure- 
ment we shall obtain fuller knowledge of what is happening 
‘ 2 * ‘ 
to us and where we are going. Only with these shall 


we be in a position even to begin to speak of control. 
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These two elements, a belief in the need for the measure- 


ment of social trends ana a feeling that information on those 
trends can be useful in social ‘planning: were present among§ those _ 


who were parr of the social indicators ‘Gorenane beginning in the 
The term "social indicators" pacaies widespread following 


«+ 1960's. 
¢ 
publication in 1966 of a Sook by ‘that ‘title edited by Raymond 


Bauer brought several prominent social scienSers together 


Y 


Bauer. 
to find ways to assess the secondary impacts of the space program. 
But their work cameinstead-to focus on broader siastions of social 


measurement, and the assessment of the state of society relative 
a 
Albert Biderman‘’s chapter in the Bauer volume 


to national goals. 
showed that pertinent statistical indicators were available for 
s 


only about half of the goals identified by the President' 
Another chapter,. "On 


F eo 
: Commission on National Goals tn 1960. 
Social Systems Accounting," called for the development of compre- 


hensive models describing ‘the structure and performance of entire 
eS . ; ‘ 
These models were proposed to counter what Bertram 


‘ 


' social systems. 
Gross called the "néw Philistinxism," the tendency of "hard" 
measurements, usu ally in dollars, to dominate equally important 


x 
Vw 
non-economic measurements of the state of society. 


but “softer”, 
In the same year,, the President's Commission on Technology, 


1 ’ s e 
’ Automation, and Economic Progress called for the development of a 

system of social accounts that “would give more balanced reckoning 
of the meaning of social and” e¢onomic progress, that would engble 


. 


us to record not only the gains of social and economic change but 


py 


we 


the costs as well...," and eventually might provide a “balance 


t 


sheet", for use in clarifying policy choices. 4 Then-Senator 


Mondale proposed | a.Couneil e social Advisers~and’ an annual social 


report from the President to congress in the several versions of. - 


_ his “Pull Opportunity and Social Accounting Act. “* He also relied - 


on this analogy to the national income accounts and their’ role in. 

the solicy presen: a: 2 = P 
These daniiy’ documents present diverse views of what 

social indicators are or should be. But they share common thenea’ 
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1) concern for the devellogmamit, and use of statistics menauesng 
the sodial state or the nation; : 


2) emaiis on measures of noneconomic dimensions of well-being; 


-and ° 


3) commitment to the idea that better information on social 
trends would improve public policy. 

Major Components. Becuase the social indicators movement 
attracted people from many disciplines and with highly diverse 
backgrounds, participants, looked to social indicators for a variety 
of purposes. Four major research traditions have evolved: 

1) net national welfare measurement 
2) national goals accounting < 
3) evaluation research and social experimentation 
4) measurement of social change 
Tt is the iast two of these--cwallmattion research and social experi- 


mentation and the measurement of social chamnge--which I will discuss 


today. Both grow out of the tradition of William Ogbumn--ame emphasizing 
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ne ‘measurement of social trends and the ther the utilization of 


* « 


‘such information in the determjnation and. analysis of public policy. 


Ifdicators i in Evaluation. ° Disappointment with the results 


of domestic social programs in the 1960's directed attention to - 


the need for a more scientific approach to program teating end a 


¢ 


evaluation, as illustrated in the New Jersey Income Maintenance 


Experiment and the evaluation of the Head Beare prouyes: In. 


: eaxiy discussions of social indicators, it was nae that in- 


dicators could be used as the bhsis for program evaluation. — 


« More recently, there has been growing interest | In the 


use of indicators for the evaluation of schools and school ‘systems. 
ww - 7 


This interest is related to two tendencies in education: 
1) public demands for accountability in education; 


2) concern for measures of educational quality. 
. © bd e 


» . 


Let us look at these more closely. es 


° 


1) In the face of declining student performance on 


he 


national tests, there have been increasing demands from parents 
and the general public that the schools be held accountable for 


student performance. When these demands are expressed at the 
Py oe ‘ 
state level, statewide assessments of edneaticned performance are 


frequently mandated, and a growing number of states have under- 
taken Parsee educational assessment programs. At present, 
some 30 to 35 states have ‘Verovisions for statewide assessments of . 


education. Certain of these, such as New York, Utah, and Oregon, 


are looking to indicators for these assessments on the assumption 


i - 
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that student performance can be monsured and ‘change in student 


e 


Pee toreaee can be linked to the "performance" of schools. 
2) Somewhat related to the use of indicators “jn state 


wide assessments is the use of indicators for measuring the mie liey: 


“ of education. For example, fears that the quality of education is 


‘declining have led the state of Pennsylvania to establish ten , 


goals of quality education which must now be measured with indica- 


tors and reported to the péblic. These are goals for individual 
students which are ‘to be achieved by the schools. Consequently, 


the school is the unit of analysis. The effectiveness of schools 


. i Riek 
in meeting these goals for students, it is assumed, can be measured 


by indicators of ‘inputs to the schools and indicators of school 


outcomes. Outcomes or output indicators include measures of 
student performance in tests of basic skills and measures of 


’ 


student attitudes and perceptions. 
Indicators dicthe measurement of social change. A broader 
view of social jiceatsen: advocated by many leading theorists 
wad peactieionsiey defines the role of indicators as one of seater 
measurement and analysis which can improve our understanding of 
what the main features of society are, how they are interrelated, 
and how these features and their relationships change. otis 
Dudley Duncan stated the case well when he wrote: "What we must 


é 


AY 
have, minimally, are quantitative statements about social conditions 


. and social processes, repeatedly available through time, the ‘relia- 
Ny . 


a“ 


AN a 
bility and validity of which are competently assessed and meet 


minimal standards." 


‘This view of social indicators has been prominent since 


oe 


the early days of the sdcial indicators movement. Social indica- 
tors as medsures of changes in Bpcret conditions had been discussed 


in the Bauer book. In seg an 800-page volume entitled Indica- 


A oe ys 


tors of Socal. Change: “concepts aria Measurement was published by 


the Sccahitcens Foundation. This veins and associated works 
* - 4 . - eo 


contained detatled reviews of conceptual and measurement problems | 


in -the delineation of demographic, social structural, and other .' 


' types of change in the United States. The conceptual and measure 
ment. problems AyD eas subjective data=~data,, that is, on ata 


aspirations, gesabene rane: and satisfactions--were examined an 


6 


The Hunan Meaning of Social ore published in 1972. Given 


the view of the social indicators enterprise aap Mie akasubanant 


of social conditions and social change, the major tasks, of social . 
hg e < 2 s He o 
indicators work can be seen as development of the data base, 


conceptual and methodological’ work toward’ the definition of * 


measures of social change, and the development of social indigator 


models. , i; fa 


“ , 
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Objections to the use of indicators in evaluation. These 


two uses Rs social indicatora--in- the measurement of: social ehange 7 


and in the evaluation of social programs .such as in education-~are 
based on two rather differen} views ef what social iaaskavers can — 
accomplish. Their differences highlight the problems inherent in 
the use of indicators for evaluation. A printipal distinction 


is that those who look: to indicators for measures of séeial change: 


emphasize the need for extensive work before the field can move far 


9 8 
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beyond the interpretation. 7 . of individual time series. Work 
is needed to diwbiso measures which are both reliable ‘ana valid. 
Reliable iheasures are those which are consistent performers and not 


’ 


subject to arbitrary shifts in meaning. Validity. is deteriined 


w 


by knowing how an sndicator” was put together, how it compares 


a 
FY 


with other measures of the same concept, and how it rises-and falls. 


s . 


In addition to reliability ana validity, we rieed to learn more 


ied 


‘about the relationships between indicators--how a change in: one_ 


. » . . 


indicator is affected by o: or leads to a change in another iridicator: 


In most areas, thts basic indicator research has, yet to be done,. 


. > or 


The use of, indicators for evaluation presupposes, that. 


we know. what indicators measure and how indicators are related. 


For example, when indicators are used to. assess schools, the 
: > 5 e : 
assumption is. made that student performance is directly and regu- 


ee - » 
. 


aerly related’ .to educational inputs such as ree performance 


. 


a ’ 3 ' 2 


or local davestment in education. While chis eee be the case, 


the influences on’ what and how much students learn are far 


broader-than what has been or.can: be reliably measured as institu- 


- 


tional .inputs to education. Schools are not closed systems nor 


is education solely a product. of the schools. And any attempt 


° 


to tie indicators of student performance exclusively to indicators 


¥ rs ™ 


of school inputs is misleading because it ignores the influence 


of home, environment, health, use of leisure time, and other 
. ’ a 
‘ fj 


factors which also affect learning. Indicators can be used to 


describe schools, trends in education, or changes in student 


10 


‘design because of the difficulty of showing that specific educa- 


performance, but indicators cannot be used to evaluate the efficiency 


of particular educational approaches, programs, or school systems. 
A further objection to the use of indicators in evaluation 


involves the recent’ emphasis on experimental design in program 
é6évaluation. The direct use of social indicators is not likely 

x - . i “4 
to be fruitful far evaluation in the absence of experimental . 


tional policies or investments, ‘rather than uncontrolled exogenous 


a) 


factors, determine the outcomes measured by indicators. Yet 


educational assessments rarely if ever, compare experimental 
schools and control schools. As Eleanor Sheldon and Howard 
Freeman have written, "The use’of indicators to evaluate programs, ~ 
x 3 


would require one to be able to demonstrate, via statistical 


manipulations, that programs determine the outcomes measured by 


? 


the indicators rather than other factors ‘causing’ the results... 


There is no possibility at the present timé of meeting the requize- 


ments of controlling for contaminating variables with available . 


statistics-that may be regarded as indicators, at least ones that 


, cover .large groups of individuals." 


1 


-The role of social indicators in education. If indica- 


‘tors cannot easily be used in evaluating schools, how can they 


be used in the field of education? At present, indicators can and 
are being used in descriptive social reporting. At the national 
level, there are a number of social reports on education: the 


National Center for Education Statistics produces two annual 


11. 
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a al The Condition of. Baieation and the er of Education 
Statistics, and. the National, Institute of Education has recentiy - - 
' published what ‘promises to be a periodic. report, 1976 Databook: 


‘The Status of Education Research and ‘Development in the United 


=f States. _State assessments of education, to the extent that they . ms 


are descriptive analyses of education rather than évaluations’ Be? : . - 


of the ehisactonat prograns in specific schools or wehool systems, pt ee Ee 


. 


also fall within this tradition. However, . thera is still a. el te an? 


* 3 - Ff 


great deal of work which needs to be done on eaneaeion indicators. 


We need to develop measures of -trends in education. which are not. - 
‘ t |. : ; 
now being measured, such as measures of curricular changes, of a ~ 


time use in the classroom, and of learning which takes place 


.outside the classroom. In addition, more work is needed to 


identify societal, local, and family influences on education. aes 


In short, education indicators are most useful when a 


© 


they describe rather than evaluate education systems and institutions, | 


“and when they are used to report on trends in education rather é 


. y 


‘than to prescribe changes in schools. 
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